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Title of the Invention 

METHOD OF REFERRING TO DIGITAL WATERMARK INFORMATION 
EMBEDDED IN A MARK IMAGE 



5 Background of the Invention 

The present invention relates to a browser page 
transmitted to a user client via a network such as Internet, 
and more specifically to a mark image attached to the 
browser page, digital watermark information embedded in the 

10 mark image, and a program that performs processing with 
reference to the digital watermark information. 

As Internet . comes into wider use, an Internet mark 
is often attached to a home page to claim a copyright of 
the home page transmitted via Internet and thereby to 

15 indicate its authenticity. However, because only attaching 
the Internet mark to the home page cannot protect copy 
causing an unauthorized use of the home page, the following 
technique is proposed; using a digital watermark technology, 
information including a mark issuer, a mark promoter, a 

20 mark provider, URL of the mark provider's site, and a mark 
period are embedded in a mark image; the authenticity of 
the home page is verified by comparing URL of the home page 
with the embedded URL of the mark provider and by checking 
the mark period. 

25 According to the above-mentioned prior art, the 
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digital watermark information embedded in the mark image is 
limited to such information described above. Therefore, 
even when processing different kinds of marks , no choice is 
given but to perform authentication in a routine manner 
5 using formula processing procedures such as URL check and 
mark period check. For this reason, it was difficult to 
change processing procedures for each kind of the marks and 
to change text information to be displayed. For example, 
ri as an example of the processing procedures, there is a 
Cj10 selectable option of either displaying a mark after 
performing mark authentication automatically or displaying 
yl the mark first before performing the mark authentication. 

5 In addition, as regards displaying of selectable 

OJ actions as a menu when a mark is pointed, it is expected 

%J 15 that the number of menu items, their names, and actions to 
^ be selected can be designed freely for each kind of marks. 

Even if the same kind of marks is processed, it is also 
expected that part of displayed text information can be 
changed for each mark provider. Moreover, when changing 
20 processing procedures and processing itself for each kind 
of marks, it is recommended that a program referring to a 
mark or a browser including the program is not changed. 

Summary of the Invention 
25 Objects of the present invention are to provide a 
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data format, which can solve the problems described above, 
by improving a data format of digital watermark information 
embedded in a mark image; and to provide a method for 
performing processing with reference to the digital 
5 watermark information having such data format. 

The present invention is characterized by digital 
watermark information in a mark image and a method for 
referring to digital watermark information in a mark image, 
the digital watermark information being embedded in the 

10 mark image, processing being performed with reference to 
the digital watermark information, wherein the digital 
watermark information comprises referred data, and an 
action definition that includes an action class and an 
index of the referred data as a parameter, the method 

15 comprising a step of referring to the action definition; 
and a step of referring to the referred data through the 
index included in the action definition to perform 
processing defined by the action class. 

In addition, the present invention is characterized 

20 by digital watermark information, which has such data 
configuration, as a transmission medium transmitted via a 
network. Moreover, the present invention is characterized 
by a browser program, which performs processing according 
to this method, as a transmission medium transmitted via a 

25 network. 



Brief Description of the Drawings 

Fig. 1 is a diagram illustrating a system 
configuration of an embodiment; 

Fig. 2 is a diagram illustrating an example of a Web 
page to which a mark is attached; 

Fig. 3 is a diagram illustrating an example of a 
menu displayed when a mark is pointed; 

Fig. 4 is a diagram illustrating an example of text 
information displayed when a menu item of "Information of 
the Mark Provider" is pointed; 

Fig. 5 is a diagram illustrating an example of a Web 
page obtained from an authentication server as a result of 
on-line authentication ; 

Fig, 6 is a diagram illustrating an example of text 
information displayed when a menu item of "Explanation of 
Mark Protocol" is pointed; 

Fig. 7 is a diagram illustrating an example of a 
home page displayed when a menu item of W A List of Mark 
Providers" is indicated; 

Fig. 8 is a diagram illustrating an example of a 
mark and text information that are displayed when URL 
discrepancy is detected as a result of off-line 
authentication of the mark; 

Fig. 9 is a diagram illustrating an example of a 
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response sentence from an authentication server, which is 
displayed in a Web page; 

Fig. 10A is a diagram that defines data classes of 
embedded data and their contents ; 
5 Fig. 10B is a diagram that defines data classes of 

embedded data and their aontenlLs (continued) ; 

Fig. 11A is a diagram that defines action class 
codes and their specific data; 

Fig. 11B is a diagram that defines action class 
*O10 codes and their specific data (continued) ; 

Fig. 12A is a diagram illustrating examples of 
"J: embedded data entities; 

^ Fig. 12B is a diagram illustrating examples of 

JI embedded data entities (continued) ; 

515 Fig. 12C is a diagram illustrating examples of 

2 embedded data entities (continued) ; 

Fig. 12D is a diagram illustrating examples of 
embedded data entities (continued) ; 

Fig. 12E is a diagram illustrating examples of 
20 embedded data entities (continued) ; 

Fig. 12F is a diagram illustrating examples of 
embedded data entities (continued) ; 

Fig. 13A is a- flowchart illustrating a processing 
flow of mark reference program 22 in an embodiment; 
25 Fig. 13B is a flowchart illustrating a processing 



flow of mark reference program 22 in an embodiment 
(continued) ; 

Fig, 13C is a flowchart illustrating a processing 
flow of mark reference program 22 in an embodiment 
(continued) ; and 

Fig. 13D is a flowchart illustrating a processing 
flow of mark reference program 22 in an embodiment 
(continued) . 



Detailed Description of Preferred Embodiments 

Embodiments of the present invention will be 
described with reference to the drawings. 

Fig. 1 is a diagram illustrating a system 
configuration of the embodiment. Assuming that an 

entrepreneur will be allowed to use an authentication mark, 
a mark issuer server 1 is a server computer for issuing the 
mark, in which information common to all mark providers of 
the mark and information specific to the entrepreneur is 
embedded, to the entrepreneur to provide an authority to 
use the mark. Generally, besides a mark issuer, there is a 
mark promoter, and a server of the mark promoter is 
provided. The mark promoter may be the same organization 
as the mark issuer. A mark provider server 2 is provided 
with the authority to use the mark by the mark issuer 
server 1, and attaches the mark to a Web page of its own. 



From the standpoint of the mark promoter, the mark provider 
server 2 is a server computer that is related to the 
entrepreneur provided with the authority to use the mark. 
A mark user client 3 is a client computer for accessing the 
mark provider server 2 to browse Web page 11 to which a 
mark image is attached. The mark user client 3 has input 
units such as a keyboard and a mouse r and a display unit. 
A mark authentication server 4 is a server computer for 
performing on-line mark authentication in response to a 
request from the mark user client 3. A network 9 is a 
network such as Internet, which connects the mark issuer 
server 1, the mark provider server 2, the mark user client 
3 , and the mark authentication server 4 . 

The mark user client 3 has a browser 21 and a mark 
reference program 22 in its memory. A processing unit of 
the mark user client 3 executes the browser 21 and the mark 
reference program 22. When, in the browser 21, URL of the 
mark provider server 2 site is specified and the Web page 
11 is requested through the network 9, WWW (World Wide Web) 
server 12 of the mark provider server 2 retrieves the Web 
page in a memory unit and then transmits the specified Web 
page 11 to the mark user client 3. The browser 21 
interprets the received Web page 11 and displays it on the 
display unit. As soon as the browser 21 detects an 
extension of the mark, control is passed to the mark 
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reference program 22. The mark reference program 22 
extracts digital watermark information embedded in the mark, 
and performs off-line mark authentication. If the mark 
attached to the Web page 11 is correct, the mark reference 
program 22 displays a formal mark image. In addition, if a 
user points a mark with a mouse, a menu is displayed. 
Using the menu, an action can be selected to obtain various 
kinds of information about mark authentication. Moreover, 
when on-line authentication of the mark is instructed, the 
mark reference program 22 accesses the mark authentication 
server 4 via the browser 21 and the network 9 to obtain 
information about whether or not the mark attached to the 
Web page is appropriate. The mark reference program 22 may 
be included in the browser 21 as its part. 

The mark image attached to the Web page 11 and the 
digital watermark information embedded in the mark image 
can be treated as a transmission medium. It is because the 
transmission medium is transmitted between the mark issuer 
server 1 and the mark provider server 2 and between the 
mark provider server 2 and the user client 3 via the 
network 9 . 

The mark reference program 22, or a program of the 
browser 21 that includes the mark reference program 22 can 
be delivered, as a transmission medium, from a destination 
server to the user client 3 via the network 9. In addition, 



the mark reference program 22 , or the program of the 
browser 21 that includes the mark reference program 22 can 
be stored in a storage medium such as CD-ROM and delivered. 

Fig. 2 is a diagram showing Web page 31 that is 
transmitted from the mark provider server 2 and that is 
displayed on a display unit by the browser 21 of the user 
client 3. The mark reference program 22 displays a mark 41 
on the Web page 31. Fig. 3 is a diagram illustrating 
information displayed in a menu 42 as a result of pointing 
the mark 41 on the same Web page 31 with a mouse. The menu 
42 displays several menu items for providing users with 
information related to the mark. Selecting one of the menu 
items causes the mark reference program 22 and the browser 
21 to display specified information on the display unit. 

Fig. 4 is a diagram illustrating an example of text 
information that is displayed in a dialog window 44 when a 
menu item of n Information of the Mark Provider" is pointed. 
The text information states that the mark promoter allows 
the mark provider who issued the Web page to use an 
authentication mark, and also states information about the 
mark provider. "Inquiry to Authentication Server" button 
45 is a button for instructing on-line authentication so as 
to call the mark authentication server 4 to verify this 
information of the Mark Provider". Using the on-line 
authentication, the user can detect a mark provider of 



10 

which mark use has been stopped or canceled before an 
effective mark period even though a formal mark is attached 
to the Web page 31. "Information of the Promoter" button 
46 is a button for accessing a Web page issued by the mark 
promoter to obtain information about the mark promoter. 
"OK" button is a button for returning control to the 
browser 21. 

Fig, 5 is a diagram illustrating an example of Web 
page 61 that is obtained from the mark authentication 
server 4 via the browser 21 when the "Inquiry to 
Authentication Server" button 45 is pressed. The Web page 
61 states that the mark provider is authorized to use the 
mark, and also states information about the mark provider. 

Fig. 6 is a diagram illustrating an example of text 
information displayed in a dialog window 47 when a menu 
item of "Explanation of Mark Protocol" is pointed. This 
example explains the origin of the on-line mark protocol, 
contents embedded in a mark, and which authentication check 
is performed. 

Fig. 7 is a diagram illustrating an example of home 
page 62 that is obtained through the browser 21 when a menu 
item of U A List of Mark Providers" is pointed. The home 
page 62 contains a list of sites provided with the 
authority to use the same mark by the mark issuer server 1. 
Because each site has URL of its home page, a user can 
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browse a specific site's home page by pointing an 
appropriate URL. 

Fig. 8 is a diagram showing the following: a mark 48 
displayed when discrepancy between URL of the mark provider 
server 2 embedded in the mark and URL of the home page is 
detected as a result of off-line authentication of the 
mark; and an example of text information displayed in a 
dialog window 49 generated as a result. "Warning to 
Authentication Server" button 50 is a button for warning 
the mark authentication server 4 of the URL discrepancy. 
Fig. 9 is a diagram illustrating a response sentence from 
the authentication server 4, which is displayed in Web page 
63. 

Figs. 10A and 10B are diagrams that define data 
classes of data, embedded in a mark as digital watermark 
information, and their contents. The data definition 
comprises a code showing a data class and data. There are 
data directly referred to and data that includes a referred 
entity-item data number as an index. The latter is data 
that is indirectly referred to through a specified entity- 
item number. 

'Character code', which is Dl , indicates a character 
code representing data such as JIS and ASCII. 1 Object 
nation code', which is D2, is a double-byte character 
representing an object nation specified by ISO 3166; if the 



12 

object nation is Japan, the object nation code is JP. D3 
is 'name of mark issuer 7 . D4 is URL of a server related to 
a mark issuer, D5 is 'name of mark promoter'. D6 is URL of 
a server related to a mark promoter. D7 is identifier (ID) 
given to the mark for which the authority to use is 
provided. 

D8 defines initialization. 'Definition item of mark 
display action' indicates No. of an entity item that 
specifies an action for an initially displayed mark. If 
the number is 0, nothing is displayed. 'Definition item of 
initial action' indicates No. of an entity item that 
specifies an action to be subsequently executed. D9 
defines a menu configuration to be displayed when a mark is 
clicked. 'Number of menu items' defines number of menu 
items to be displayed. 'A list of action definition items' 
indicates No. of an entity item that defines an action to 
be executed when each menu item is selected. A name of 
each action is displayed as a menu item name. 

D10 defines an action to be executed if a mark is 
displayed after off-line authentication of a Web page to 
which the mark is attached. 'Number of actions' is number 
of executable actions. 'A list of definition items of mark 
display action' shows a list of entity item Nos. that 
define each action. Dll defines an action to be executed 
when text is displayed after off-line authentication. 



'Number of actions' is number of executable actions. 'A 
list of definition items of text display action' shows a 
list of entity item Nos . that define each action. D12 
defines a URL of at least one Web page to which the mark is 
attached. 'Number of attached URLs' is number of URLs for 
Web pages to which the mark is attached. Attached page URL, 
which has a not-omissible portion and a omissible portion 
as a set, defines at least one set. 

In Fig. 10B, D13 defines 'number of attached IP 
addresses', 'IP version code of server IP address on 
attached page', and its 'IP address data' as information 
about IP addresses of servers in which each attached page 
exists. D14 defines 'start of mark period' by 'starting 
year, month, day, hour, min'. D15 defines 'end of mark 
period' by 'ending year, month, day, hour, min'. D16 
defines a hash value, as 'characteristic value of the 
contents', obtained from contents of a Web page. D17 
defines URL of an authentication server that performs on- 
line authentication of a Web page to which the mark is 
attached, 

D18 is 'action for mouse HOVER', and defines No. of 
an entity item that defines an action executed when a mouse 
cursor is put on a mark. D19 is 'action for mouse LEAVE', 
and defines No. of an entity item that defines an action 
executed when a mouse cursor on a mark is moved off the 
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mark. 

D20 is 'action for pressing of mouse left button', 
and defines No. of an entity item that defines an action 
executed when on a mark a mouse left button is pressed. 
D21 is 'action for pressing of mouse right button', and 
defines No. of an entity item that defines an action 
executed when on a mark a mouse right button is pressed. 

D22 is special data for defining an action. 'Action 
name' is a name representing the action, which is defined 
only when the action name is an object to be displayed. 
'Action class code' is a code representing an action class. 
The details of 'Action class code' are defined by 
definitions of action class codes shown in Figs. 11A and 
11B. 'Action class specific data' defines data required to 
execute the action. D23 is a general purpose IP address, 
and specifies an IP version code. D24 is 'general purpose 
URL', and defines URL of a Web page other than an 
authentication page of an authentication server. D25 is 
'text', and defines information to be displayed in a dialog 
window that is generated in relation to a Web page to which 
the mark is attached. 

Figs. 11A and 11B are diagrams that define action 
class codes and their specific data. The action definition 
has a data configuration comprising: an action code 
representing an action class; and a parameter portion that 
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is data required for the action. The action definition of 
*menu display f (Al) , however, does not include a parameter 
portion in the action definition because it refers to 
^definition of menu configuration' (D9) as data implicitly. 
5 Parameter portions of *mark display' (A7) and Execution of 
add-on program' (A8) are data that is directly referred to. 
Parameter portions of the other action definitions include 
a referred entity-item No. as an index. In other words, an 
indirect addressing method, by which data is referred to 
10 through a specified entity-item No., is used. 

x Menu display' action, which is Al , displays a pop- 
up menu that is specified in the item of * definition of 
menu configuration' defined in D9 . Action data is 

specified in an action definition item accessed through 
15 * definition of menu configuration'. An entity-item No. of 
* definition of menu configuration' may be specified as an 
action data. * Off-line authentication', which is A2 , 
performs authentication by comparing information obtained 
from reference environment with authentication information 
20 in an entity, and then generates an authentication result 
code. Based on this authentication result, the mark is 
displayed according to x definition item of mark display 
after authentication'. In addition, if * definition item of 
text display after authentication' is not 0, text is 
25 displayed according to this . 11 Balloon display ' , which is 
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A3, generates a window having only frame lines , and then 
displays text information of an item specified by * item 
number of displayed text r in this window. 

'Text display' , which is A4 , generates a dialog 
5 window having an action name defined in D22 as a title , and 
then displays information of fixed text specified by * item 
number of displayed text f in this window. In addition, if 
variable information is inserted in the text, a text, which 
is defined by 'number of objects inserted in the text' and 
yfJ10 'object information inserted in the text', is inserted in 
r "i the text before displaying it. The 'object information 
W inserted in the text' is an entity-item No. for specifying 

the inserted text, or is a system information code. 
Jr; Moreover, if a button is displayed in addition to the text, 
~:15 'number of additional buttons' and 'a list of definition 
f: items of action for additional button' are specified. A 

definition item of action for additional button specifies 
an action that is executed when the button is pressed. 

'Web page display', which is A5 , obtains a Web page 
20 specified in an URL item r and display it in a new browser 
window. The URL item is an URL representing the location 
of the Web page. 'Action item number on extinction of link 
destination' refers to a link destination existence flag, 
and defines No. of an entity item that specifies an action 
25 to be executed when the link destination becomes extinct. 



Not performing link check at the time of initialization 
results in invalid. In addition, if the * action item 
number on extinction of link destination' is 0, no action 
is performed when link destination becomes extinct. 

11 Communications with server', which is A6 , issues a 
request specified by * request class code' to a server 
specified by * server URL item number ', and processes 
response data received from the server according to 
'response processing code'. 'Mark display', which is A7 , 
applies an effect specified by 'image effect code' to a 
mark image, and overlays a text specified by * synthesized 
text' on the mark image before displaying it. The text is 
displayed according to 'text body color code', 'text frame 
color code', and 'font code'. The text is synthesized only 
when it is instructed by the 'synthesized text'. 

In Fig. 11B, 'execution of add-on program', which is 
A8, interprets a program described in a script language as 
action data, and then executes the program. The program 
description in the script language may be specified in 
* text' of D25. An entity-item number of this 'text' may be 
specified in action data of action definition. 

At the time of initialization, 'link check' of A9 
checks whether or not extinction of a Web page related to 
mark authentication, or the like, causes inaccessibility, 
and then stores the result in memory as a link destination 
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flag. 'General purpose URL item number' is No. of an 
entity item that stores an object URL. 'Action on OK item 
number ' is No . of an entity item that defines an action to 
be executed when contents could be accessed. 'Action on NG 
5 item number' is No. of an entity item that defines an 
action to be executed when contents could not be accessed . 
When a Web page could be accessed, the Web page is not 
displayed. If an action item number is 0, the action is 
not performed. 

10 Figs. 12A through 12F are diagrams illustrating 

examples of a data entity embedded in a mark as digital 
watermark information. 'Item No.' at the top of each line 
acts as an index that can be referred to, as a parameter, 
from the other entity item data. A D code' is a code 

15 representing a data class . The top of an entity item that 
specifies an action definition is an action name. However, 
as regards an action definition that defines an action 
executed when a menu item is pointed, an action definition 
that defines an action executed when a button is pressed, 

20 and an action definition that defines an action for opening 
a dialog window to display a text, the top of the entity 
item is also used as a label or a title. n " is set to an 
action name of an action definition that does not use a 
label or a title. 

25 Character code, object nation code, name of mark 
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issuer, mark issuer URL, name of mark promoter, mark 
promoter URL, and individual mark ID are set to item Nos . 1 
through 7 respectively. Item No. 8 shows initialization, 
item No. 17 defines a mark display action, and item No. 15 
5 defines an initial action after displaying the mark. Item 
No. 17 indicates that A7 action (mark display) is performed 
with a text "in authentication" overlaid on the mark. Item 
No. 15 specifies the following: A2 action (off-line 
authentication) is performed; and a mark is displayed 
according to item No. 10 after the off-line authentication. 
Item No. 10 specifies the following: a mark is displayed 
m after off-line authentication; if a result of the 
y : l authentication is correct, the mark is displayed according 
p to item No. 21; if URL is invalid, the mark is displayed 
CJ5 according to item No. 22; and if effective period of the 
C3 mark expires, the mark is displayed according to item No. 

24. Item No. 21 specifies that a formal mark is displayed 
without image effect and synthesized text. 

Item No. 12 specifies that balloon is displayed 
20 according to item No. 14 when detecting that a mouse cursor 
is put on a mark. Item No. 14 specifies that A3 action 
(balloon display) is performed and a text specified in item 
No. 32 is displayed in the balloon. 

Item No. 13 specifies that a menu is displayed 
25 according to item No. 16 when on a mark a mouse left button 
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is pressed. Item No. 16 specifies that Al action (menu 
display) is performed. Item No. 9 specifies a menu 
configuration. Judging from the menu configuration, the 
menu has three items and item names are specified in item 
Nos. 18, 19, and 20. 

Item No. 18 specifies the following: when 
"Information of the Mark Provider 11 item is pointed, a mark 
is displayed according to item No. 10 after off-line 
authentication; and then a text is displayed according to 
item No. 11. Item No. 11 specifies the following: if a 
result of authentication is correct, a text is displayed 
according to item No. 26; if URL is invalid, the text is 
displayed according to item No. 23; and if effective period 
expires, the text is displayed according to item No. 25. 
Item No. 26 specifies A4 action (text display) to be 
executed. Fixed text information is specified in item No. 
38. Variable information to be inserted in a text is 
specified in item Nos. 39, 40, 41, 42, and 35. In addition, 
two additional buttons are provided. The names of those 
buttons are specified in item Nos. 27 and 28. Item No. 27 
specifies that A6 action (communications with server) is 
executed when "Inquiry to Authentication Server" button is 
pressed. Server URL is specified in item No. 31. A request 
code to the server is 1, and a response processing code is 
3. Item No. 28 specifies A5 action (Web page display) to 
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be executed when "Information of the Promoter" button is 
pressed. The URL is specified in item No. 6. 

Item No. 19 instructs that a menu is displayed 
according to item No. 33 when "Explanation of Mark 
Protocol" item is selected. There is no variable 

information to be inserted in a text and no additional 
button . 

Item No. 20 specifies that Web page display is 
performed when "A List of Mark Providers" item is selected. 
URL of the Web page is specified in item No. 30. 

Item No. 22 indicates the following: if off-line 
authentication proves URL to be invalid, a mark is 
displayed with a text "invalid mark use" overlaid on the 
mark; and then the text is displayed according to item No. 
23. Item 23 specifies that a dialog window with a title of 
"invalid mark use" is generated to display a text. Fixed 
text information is specified in item No. 34. Variable 
information to be inserted in a text is specified in item 
Nos. 35 and 1. URL of the Web page is overlaid on an 
entity of item No. 1. In addition, one additional button 
is provided. The name of the button is specified in item 
No. 29. 

Item No. 24 indicates the following: if off-line 
authentication proves expiration of effective period, a 
mark, is displayed with a text "expiration of effective 



period" overlaid on the mark; and then the text is 
displayed according to item No. 25. Item 25 specifies that 
a dialog window with a title of "expiration of effective 
period" is generated to display a text. Fixed text 
information is specified in item No . 36 . Variable 
information to be inserted in a text is item No. 37 and 
current time specified by system information code SI. In 
addition, one additional button is provided. The name of 
the button is specified in item No. 29. 

Fig. 12E is a diagram illustrating an example of an 
entity relating to link check. Item No. 3 specifies that 
on initialization an initial action shown in item No. 4 is 
executed. Item No. 4 indicates the following: A9 action 
(link check) is executed; a Web page of which URL is shown 
in item No. 2 is accessed; if the contents could be 
accessed, a link destination existence flag on the memory 
is set to X 0K' ; and a mark display action of item No. 5 is 
executed. As regards item No. 5, a character string *0K' 
are overlaid on a mark image to be displayed. If the 
contents could not be accessed, the flag on the memory is 
set to * NG ' and a mark display action of item No. 6 is 
executed. As regards item No. 6, a character string ^NG' 
is overlaid on the mark image to be displayed. When "A 
List of Mark Providers' 1 menu item or button is pressed, an 
action definition specified in item No. 1 is executed. In 



other words, the link destination existence flag is 
referred to for checking whether or not a general purpose 
URL -specified in item No. 2 is accessible. If this flag is 
'NG', a link destination Web page specified in item No. 2 
is not accessed. Accordingly, a Web page that is being 
displayed is not changed. If this flag is *0K', the link 
destination Web page is accessed through the browser 21, 
and then the Web page is displayed. 

If 'action item number on extinction of link 
destination 1 is specified in item No. 1, an action of 
specified entity item such as text display is executed. 

Fig. 12F is a diagram illustrating an example of an 
entity related to execution of an additional program 
embedded in a mark image. Item No. 1 specifies that an 
additional program of item No. 2 is executed when detecting 
that a mouse cursor is put on a mark. Item No. 2 executes 
a processing program described in a data portion. As an 
example of the additional program processing, when a mouse 
cursor is put on a mark image, a balloon is displayed and a 
scrolling text is displayed in the balloon. 

Such additional program enables us to add a function 
that cannot be described by the above-mentioned entity 
items . 

By the way, a digital signature for digital 
watermark information as a whole is set at the end of the 



digital watermark information. 

Figs. 13A through 13D are flowcharts illustrating a 
processing flow of a mark reference program 22. The mark 
reference program 22 , controlled by the browser 21 that 
displays Web page 31 and detects a mark extension, extracts 
digital watermark information embedded in a mark image 
(step 71). Next, a digital signature embedded in a mark is 
verified (step 72) . If the digital signature is proved to 
be unauthorized, processing is stopped. If the digital 
signature is correct, the digital watermark information is 
expanded on the memory to create a data entity (step 73) . 
In the next place, data of the data class 8 in the data 
entity is referred to for initialization, an initial mark 
is displayed (step 74) , and off-line authentication is 
performed (step 75) . If a result of the authentication is 
correct (step 76, OK), a mark 41 is displayed on the Web 
page 31 (step 77) . When the mark 41 is clicked, the menu 
42 is generated according to data of the data class 9 and 
then the menu is displayed on the Web page 31 (step 78) . 

In Fig. 13B f when "Explanation of Mark Protocol" 
menu item is selected (step 79 - explanation of mark 
protocol) , the mark reference program 22 generates the 
dialog window 47, and displays specified text information 
in this dialog window 47 (step 80) . If X A List of Mark 
Providers' menu item is selected (step 79 - a list of mark 



providers) , the mark reference program 22 obtains the 
specified Web page 62 through the browser 21 and displays 
the page in a browser window (step 82) . 

If "Information of the Mark Provider" menu item is 
selected (step 79 - information of the mark provider) , the 
mark reference program 22 executes off-line authentication. 
If a result of the authentication is correct, the mark 
reference program 22 generates the dialog window 44, and 
displays the text with the object information inserted 
therein (step 81) . At this time, "Inquiry to 

Authentication Server" button 45 and * Information of the 
promoter" button 46 are displayed. When "Inquiry to 
Authentication Server " button 4 5 is pressed (step 83 - 
inquiry to authentication server) , the mark reference 
program 22 inquires of the mark authentication server 4 
through the browser 21, and displays obtained Web page 61 
in the browser window (step 84) . The mark reference 
program 22 transmits information, which is required for 
online authentication, including URL of the mark provider, 
URL of Web page to which the mark image is attached, and 
mark period, to the mark authentication server 4 through 
the browser 21. When " Inf ormation of the Promoter" button 
46 is pressed (step 83 - information of the promoter) , the 
mark reference program 22 obtains a Web page from a server 
related to the mark promoter through the browser 21, and 



then displays the Web page in the browser window (step 85) . 

In Fig. 13C, as a result of the off-line 
authentication, when the mark reference program 22 detects 
invalid URL use (step 7 6 - URL invalid) , the program 
displays a mark 48 on which the text of ^invalid mark use" 
is overlaid (step 91), generates the dialog window 49, and 
displays the text with the correct URL and URL of the Web 
page, which is being referred to, inserted therein (step 
92). At this time, "Warning to Authentication Server'' 
button 50 is displayed. When the mark reference program 22 
detects that "Warning to Authentication Server" button 50 
is pressed (step 93 - warning to authentication server) , 
the program warns the mark authentication server 4 , and 
displays obtained Web page 63 in the browser window (step 
94) . 

In Fig. 13D, as a result of the off-line 
authentication, when the mark reference program 22 detects 
expiration of effective period (step 76 - expiration of 
effective period) , the program displays a mark on which the 
text of ^expiration of effective period" is overlaid on the 
mark (step 101) , generates a dialog window, and displays 
the text with effective period and current time inserted 
therein (step 102) . Because "Warning to Authentication 
Server" button 50 is displayed at this time, the steps 93 
and 94 described above can be performed. 



It should be noted that, in step 74, data of the 
data class 8 in the data entity is retrieved before an 
initial mark is displayed, but if the data of the data 
class 8 in the data entity does not exist, conditions of 
waiting for operation may be provided after retrieving 
* 1 A7 | 0 1 " data in item No. 21 and displaying the formal mark 
41. 

In addition, a menu item for instructing off-line 
authentication may also be provided. In this case, when 
"Off-line Authentication" is selected, A2 (off-line 
authentication) is performed. According to this method, it 
becomes possible to perform the following: first, the 
normal mark 41 is displayed; when the mark 41 is clicked, 
the menu 42 including "Off-line Authentication" is 
displayed; and when "Off-line Authentication" menu item is 
selected, off-line authentication is performed. Moreover, 
a menu item for instructing on-line authentication may also 
be provided so that it becomes possible to instruct on-line 
authentication immediately after displaying the mark 41. 

Furthermore, in step 81, when "Information of the 
Mark Provider" menu item is selected, the off-line 
authentication, which is the same as that performed in step 
75, is repeated. However, the text may be displayed 
immediately without performing the off-line authentication. 

In this embodiment, when "A List of Mark Providers" 
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provided as a menu item or "Information of the Promoter" 
button provided as a button is selected, the specified Web 
page is obtained and displayed in a browser window. In 
such a manner, using a Web page obtaining means, a user can 
obtain documents such as a written oath sworn by a mark 
provider, contract documents, and covenants. The user can 
also check the authenticity of those documents by 
performing mark authentication in a similar manner and 
verifying a digital signature provided by a mark promoter 
and the like. 

According to this embodiment, the number of items to 
be displayed when a mark is pointed, names of menu items 
and their actions can be specified for each mark. In 
addition, an order of processing can be designed in 
response to each mark; for example, an order of off-line 
authentication action and mark display action is specified 
for each mark. In addition, a text, which is displayed in 
a dialog window when a menu item or a button is pressed, 
can be specified for each mark. And by inserting 
information related to a mark provider in a variable 
portion of the text, a text including information specific 
to the provider who attaches the same mark can be generated. 
Moreover, when a user instructs to display a Web page that 
cannot be accessed by the user, it is possible to notify 
the user, without changing a display screen, that the link 



destination does not exist. Furthermore, as digital 
watermark information, an entity of an additional program 
can be embedded in a mark image. Therefore, it is possible 
to add processing involved in mark authentication that 
cannot be described by the data definitions and the action 
definitions described above. 

As described above, settings of digital watermark 
information can be changed for each kind of mark. In such 
a manner, without changing the mark reference program 22, 
it is possible to specify authentication-related 
information of the mark and to add a function. 

As mentioned above, according to the present 
invention, because a data format of digital watermark 
information embedded in a mark image is specified, and 
because entity items for specifying data and entity items 
for defining actions can be designed freely, it is possible 
to change processing procedures according to a kind of mark, 
and to specify the number of menu items to be displayed, 
names of menu items and their actions freely. In addition, 
a program, which refers to digital watermark information 
having such data format, can provides a user with several 
means for verifying authenticity of a mark and of a home 
page to which the mark is attached; for example, off-line 
authentication, on-line authentication, explanation of mark 
protocol purport, a guarantee letter by a mark provider, 
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and the like. Moreover, when invalid mark or invalid 
attachment of a mark is detected, the program can provide 
the user with a means for notifying it to an authentication 
server. Even in the case of the same mark, it is possible 
to make contents of text information to be displayed 
variable according to a mark provider. Furthermore, 
because a function of adding a program is provided, 
processing that cannot be described by the specified data 
definitions and the specified action definitions can be 
added. 

In this manner, abundance of the data description 
formats in digital watermark information itself and the 
function of adding an additional program enable to design a 
data entity embedded in a mark in response to a kind of 
mark by means of digital watermark technology, without 
changing a mark reference program and a browser including 
the program, and to perform a variety of mark 
authentication processing. Additionally, because we can 
include text information in the digital watermark 
information and display it in a dialog window, this 
function enables us to avoid communication for obtaining a 
Web page through Internet. 



